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PREAMBLE 


The  procedures  described  in  this  handbook  were  piloted  in  eight  classrooms  from  September  to 
December,  1991.  The  teachers  of  these  classrooms  (referred  to  as  pilot  teachers)  were  experienced 
mathematics  teachers. 

The  pilot  teachers  attended  two  days  of  inservice  which  covered  all  aspects  of  the  pilot  process, 
from  the  philosophy  of  problem  solving  to  filling  out  necessary  project  forms. 

The  pilot  teachers  recorded  students’  problem  solving  dispositions  at  the  beginning  and  at  the 
end  of  the  pilot  period.  They  administered  six  problems  to  their  classes  and  each  student  response 
was  assessed  twice. 

Four  university  graduate  students,  who  were  coached  in  “flexible  interviewing”  techniques, 
recorded  both  video  and  audiotapes  of  interviews  they  conducted  with  two  students  per  classroom 
piloted  during  each  problem  solving  session. 

The  pilot  teachers  documented  observations  they  made  of  three  students  during  each  pilot 
problem  assignment. 

An  outline  of  the  activities  and  outcomes  of  the  EQI -Mathematics  project  for  each  phase  from 
1989  to  1992  can  be  found  in  the  Appendix  of  this  handbook. 
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INTRODUCTION 


In  recent  changes  to  Alberta  mathematics  curricula,  the  most  important  goal  of  instruction 
became  the  development  of  students’  abilities  to  solve  problems.  Problem  solving  includes  the 
acquisition  of  specific  skills  and  processes  as  well  as  the  development  of  positive  attitudes  towards 
the  use  of  mathematical  reasoning  in  many  different  life  situations.  These  expectations  have  been 
accompanied  by  some  change  in  teaching  methods  in  schools,  and  intense  interest  in  developing  new 
methods  for  assessment. 

The  EQI-Math  project  was  undertaken  to  identify  effective  non-traditional  methods  of  assessing 
problem  solving  in  mathematics.  The  goal  of  this  handbook  is  to  provide  some  guidance  to  teachers 
to  help  and  encourage  them  to  adopt  these  methods  in  their  teaching.  It  is  a handbook  for  all 
teachers  since  even  experienced  teachers  need  help  with  effective  assessment  because  it  is  more 
complex  than  it  appears. 

Assessment  is  the  act  of  acquiring  and  interpreting  information  about  students  for  some  stated 
purpose.  In  this  case,  the  purpose  is  the  improvement  of  learning  and  teaching  of  problem  solving 
for  both  teachers  and  students. 

The  handbook  outlines  three  methods  of  assessment  — observation,  flexible  interviewing  and 
holistic  analysis.  Each  is  presented  in  a separate  section.  However,  they  are  not  alternative  methods 
and  one  cannot  be  chosen  over  the  others.  They  focus  on  different  aspects  of  the  students’  behaviour. 
Observation  focuses  on  the  students’  actions,  interviewing  focuses  on  their  thinking  and  holistic 
analysis  focuses  on  their  written  work.  All  three  methods  are  necessary  components  of  the 
assessment  model  they  define  and  must  all  be  considered  in  exploring  and  assessing  the  students’ 
understanding  of  problem  solving. 

The  problem  solving  solutions  presented  in  this  handbook  are  consistent  with  the  philosophy  of 
the  Program  of  Studies.  This  material  has  been  reviewed  by  the  Alberta  Education  Curriculum 
Department  and,  although  it  is  not  intended  as  a core  resource,  it  does  support  the  Alberta 
mathematics  curricula. 
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SECTION  1 


OBSERVATION 


▲ FOCUS  ON  ACTIONS  ▼ 

Valuable  assessment  information  about  a student  can  be  obtained  from  direct  observation.  In 
using  this  method,  targeted  students  are  watched  carefully  and  their  behaviours  are  noted  and 
interpreted.  Observation  can  range  from  nonstructured  or  informal,  where  one  watches  the  student 
engaged  in  problem  solving  and  gets  an  overall  picture  of  the  situation,  to  highly  structured  or 
formal,  where  each  of  the  student’s  behaviour  is  recorded  and  the  frequency  of  occurrences  noted 
over  a specified  period  of  time.  Teachers  should  try  to  function  closer  to  the  formal  than  the 
informal  end  of  the  continuum  when  they  intend  to  use  it  for  assessing  the  students. 


To  engage  in  effective  and  meaningful  observation,  the  following  guidelines  should  be 
considered. 

1.  Observation  should  be  used  to  capture  those  qualities  of  a student’s  behaviour  that  cannot  be 
more  easily  assessed  using  other  methods.  The  focus  should  be  on  students’  actions  to  assess 
attitude.  As  chosen  students  solve  problems,  either  working  individually  or  in  a small  group, 

watch  them, 

listen  as  they  talk  to  others  and 
record  your  observations. 

2.  Observation  should  cover  the  following  situations  of  a student’s  behaviour. 

i)  Student  participation  and  interaction  with  people  — one’s  self,  one’s  teacher,  one’s 
peers. 

ii)  Student  participation  and  interaction  with  tasks  — the  problems. 

iii)  Student  participation  and  interaction  with  objects. 

The  following  are  some  of  the  observations  made  by  a sample  of  experienced  mathematics 
teachers  (participants  of  the  EQI  project)  that  have  been  categorized  under  the  three  components  to 
illustrate  the  nature  of  the  observation  for  each. 


I)  Participation  and  Interaction  with  people. 


Self 

talked  to  himself 

stretched 

yawned 

gazed  into  air 

looks  around 

worked  alone 

looking  down 

leaning  head  on  hand 

hands  on  chin 

frowning 

smiling 

bites  nails 

sits  very  thoughtful 


Peers 

listened  to  partner 
talks  with  partner 
compares  what  partner  has 
teaches  “K”  how  to  divide 
brainstorming  with  others 
joins  in  group  discussion 
discusses  with  partner 
works  independent  of  partner 
corrects  “J’s”  thinking 
initiated  discussion 


Teacher 

asks  to  return  to  own  desk 
asks  a question  about 
a problem  e.g.  Does  it  mean 
by  four? 

Which  way  is  East? 

Is  this  right? 

Is  my  logic  correct? 


5 


II)  Participation  and  Interaction  with  tasks. 

reading 

writing 

drawing  — stamps,  a box,  people,  a rabbit,  etc. 

tries  another  set  of  two  numbers 

wrote  out  what  he  knew 

checks  graph 

recopied  problem 

paused-started-paused-started 


rereads 

no  marks  on  paper 
working  continually 
began  working  immediately 
records  8 

writing  sentence  to  answer  the  problem 
colouring 

10  mins  before  writing  anything 


III)  Participation  and  interaction  with  objects. 


erasing 

used  calculator 

slouched  in  chair 

took  watch  off  and  put  it  on 

rubbed  eraser  between  fingers 

dropped  pencil 

kicks  lunch  bag 

looking  at  wall 

leaning  over  back  of  desk 


playing  with  paper 
sideways  in  desk 

looking  over  back  of  desk  at  floor 
using  fingers  (to  count) 
choosing  pencil 

counts  14  cubes  - connects  into  a train 
plays  with  unifix 
pencil  tapping 


These  components  may  not  always  be  mutually  exclusive.  However,  the  goal  is  not  to  isolate  them 
or  develop  distinct  boundaries,  but  to  make  sure  that  they  are  all  considered  in  the  process.  It  is 
important  to  cover  all  three,  not  necessarily  in  the  same  observation,  to  avoid  biased  or  conflicting 
assessment. 

3.  Observation  should  be  linked  to  problem  solving  dispositions. 


Problem  Solving  Dispositions 

Motivated 

• shows  interest,  curiosity,  enthusiasm  and  inventiveness  in  doing  mathematics* 

• goes  beyond  the  assignment 

• reluctant  to  stop* 

• works  to  a goal 

• works  until  satisfied  with  solution 

• works  for  a lengthy  period  using  one  strategy 


Creative 

• flexible  in  exploring  mathematical  ideas* 

• tries  alternative  methods* 

• invents  own  problems,  formulates  problems 

• able  to  improvise  in  selecting  materials  to  represent  the  problem 
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Confident 

• belief  in  ability  to  use  mathematics  to  solve  problems* 

• belief  in  ability  to  reason* 

• not  afraid  to  make  mistakes 

• belief  that  problems  can  be  solved 

• ability  to  identify  and  use  necessary  resources 

• prepared  to  demonstrate  for  other  students 

• belief  in  ability  to  communicate  ideas 

Strategic  Approach 

• can  state  the  problem  in  own  words 

• understands  the  meaning  of  words  in  the  problem 

• is  able  to  draw  a diagram  that  reflects  the  problem 

• knows  what  information  is  needed  to  solve  the  problem  and  what  information 
is  extraneous** 

Strategic  Process 

• uses  organized  and  logical  approaches 

• takes  time  to  stop  and  think 

• notices  and  corrects  one’s  mistakes** 

• monitors  one’s  thinking*  - is  reflective 

* Terminology  used  in  NCTM,  Curriculum  and  Evaluation  Standards  for  School  Mathematics^ 
1989.  p.  228 

**  Terminology  used  in  Alberta  Education,  Diagnostic  Mathematics  Program,  1991,  “Cognitive 
Processes.” 

These  mathematical  dispositions,  identified  by  the  EQI-Math  project,  should  be  used  to: 

i)  frame  the  observations,  i.e.,  to  determine  what  aspect(s)  of  students’ 
behaviour  to  focus  on; 

ii)  interpret  the  students’  actions. 

The  dispositions  describe  the  type  of  behaviours  that  are  associated  with  successful  problem 
solving.  Thus  they  should  be  used  as  a basis  of  determining  whether  a student  possesses  or  does  not 
possess  these  qualities.  It  is  more  useful  to  wait  after  a few  observations  before  making 
interpretations.  Interpretation  after  each  observation  could  be  misleading  since  a trend  cannot  be 
established  with  one  or  two  observations.  Only  a few  students  (1  to  4)  should  be  observed  in  a given 
problem  solving  situation. 
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The  following  are  two  cases  of  observations  drawn  from  “anecdotal  records”  (records  of 
observation  and  interpretation)  prepared  by  the  participating  mathematics  teachers  of  the  EQI- 
Math  project.  The  interpretations  provided  in  these  cases  should  be  viewed  as  samples  of  how  the 
mathematical  dispositions  can  be  used  as  a basis  of  assessing  the  students’  actions  and  not  as  recipes 
to  be  followed  thoughtlessly.  Thus  it  is  the  process  more  than  the  product  of  the  interpretation  that 
is  being  illustrated  here. 

CASEl 


Observation  #1 

Read  problem  a couple  of  times. 

Partner  initiated  discussion. 

Listened  attentively  to  partner. 

Made  no  suggestions. 

Discussion  ended,  but  wrote  nothing  at  first. 
Tried  to  apply  what  partner  told  her. 
Worked  with  ease  for  a few  minutes. 

Started  to  struggle  with  solution. 

Crossed  out  things  on  her  paper. 

Stuck  to  same  method. 

Continued  struggling  on  her  own. 


Observation  #2 
Read  problem. 

Started  right  away  with  a chart. 

Checked  and  discussed  with  partner. 
Partner  did  most  of  the  explaining. 

Sat  very  thoughtful. 

Started  writing. 

Wrote  a lot,  worked  intently. 

Went  to  teacher,  asked  if  logic  was  correct. 
Returned  to  her  seat. 

Continued  to  write  and  work  on  solution. 


Observation  #3 

Discussed  problem  with  partner. 
Listened  while  partner  explained. 
Started  writing. 

Kept  writing  without  any  stops. 
Worked  continually  for  about  1 hour. 
Completed  solution  correctly. 

Looked  happy. 


Observation  #4 
Read  question. 

Had  brief  discussion  with  partner. 

Got  right  down  to  work. 

Continued  working  on  problem  with  no 
pause. 

Completed  after  20  minutes. 

Got  a right  answer. 

Seemed  pleased  with  herself. 


Interpretation 

The  trend  established  over  this  set  of  observations  indicates  that  this  student  is  very  motivated. 
She  shows  interest  by  seeking  help  from,  or  engaging  in  discussions  with  her  partner.  She  works  for 
lengthy  periods  and  works  to  a goal,  i.e.,  until  satisfied  with  her  solution.  She  showed  no  reluctance 
in  getting  started  and  stayed  focused  throughout  the  process.  There  is  no  indication  of  creativity.  She 
doesn’t  seem  to  be  very  confident  in  that  she  didn’t  take  the  lead  in  discussions  with  her  partner, 
started  her  solution  only  after  receiving  help  or  suggestions  from  her  partner  and  queried  her  teacher 
about  her  logic. 

There  isn’t  adequate  information  to  draw  conclusions  about  strategic  approach  and  process  since 
the  observations  did  not  focus  on  these  qualities  of  the  student’s  behaviour  consistently.  More  infor- 
mation on  what  she  talked  about  with  her  partner  and  what  she  was  doing  on  her  page  is  needed.  If 
she  was  simply  doing  what  her  partner  told  her  in  a rote  manner  then  she  could  be  considered  weak 
in  these  dispositions. 
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CASE  2 


Observation  #1 

Read  problem  over  and  over  again. 

Had  lost  look  on  his  face. 

No  discussion  with  partner. 

Stared  at  paper. 

Seemed  afraid  to  write  things  down. 

Continued  staring  for  about  10  minutes  before 
writing  something  down. 

Wrote  very  little. 

Kept  looking  around  at  others. 

Had  very  litde  down  on  paper  after  20  minutes. 
Had  no  real  strategy. 

Did  not  do  much. 


Observation  #2 
Read  question. 

Stared  at  paper. 

Started  writing  after  about  5 minutes. 
Long  pause  — staring,  looking  around,  no 
writing. 

Started  to  write  again. 

Seemed  to  struggle  to  find  a solution. 
Continued  to  struggle  — wasn’t  sure  what 
to  do,  which  way  to  go. 


Observation  #3 

Read  problem  over  and  over  again. 

No  discussion  with  partner. 

Started  writing. 

Stopped,  sat  and  did  more  thinking. 
Appeared  lost. 

Wrote  again. 

Continued  working  for  about  15-20  minutes. 
Stopped  and  closed  booklet. 

Was  able  to  work  out  some  solution. 


Observation  #4 
Read  question. 

No  discussion  with  partner. 

Some  time  elapsed  before  he  started  to 
write  anything. 

Looked  straight  ahead  for  a few  seconds. 
Reread  question. 

Started  writing  after  5 or  6 minutes. 

Started  to  find  different  paths  on  diagram. 
Paused. 

Started  again. 

Got  lost  in  his  counting,  got  confused  but  kept 
trying. 

Completed  question  in  30  minutes. 


Interpretation 

This  student  seems  to  be  somewhat  motivated  in  that  he  is  willing  to  try  the  problems,  does  not 
quit  even  though  he  encounters  a lot  of  difficulties  and  tries  to  get  to  a solution  on  his  own.  There  is 
no  indication  of  creativity.  Although  working  alone  could  reflect  confidence,  in  this  case,  given  the 
difficulties  the  student  encountered  and  that  he  did  not  engage  his  partner  in  a discussion,  it  is  more 
likely  to  be  a case  of  lacking  confidence  and  not  knowing  how  to  interact  with  his  partner.  His 
hesitancies  suggest  a fear  to  make  mistakes.  He  also  seems  to  be  unable  to  identify  and  use  necessary 
resources  given  the  amount  of  time  he  spent  gazing  and  looking  around. 

The  trend  over  the  observations  most  strongly  shows  poor  strategic  approaches  because  of  the 
difficulties  on  what  to  do,  the  many  readings  of  the  problems,  the  staring,  the  thoughtless  pauses, 
the  random  stops  and  starts,  etc.  In  fact,  this  disposition  seems  to  be  the  most  significant  contributor 
of  the  student’s  difficulties. 
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SECTION  2 FLEXIBLE  INTERVIEWING 


A FOCUS  ON  THINKING  ▼ 

Several  aspects  of  the  problem  solving  process  are  not  revealed  by  the  written  solution.  Finding 
out  what  goes  on  in  a student’s  mind  as  he/she  solves  a problem  is  crucial  to  effective  assessment. 
Flexible  interviewing  is  a process  that  can  be  used  to  get  into  a student’s  mind  to  gain  valuable 
insights  of  the  student’s  thinking  and  perspective  of  making  sense  of  the  problem  solving  process. 

Flexible  interviewing  is  an  open-ended  procedure  intended  to  give  the  student  a chance  to  display 
his/her  natural  inclination  in  solving  the  problems.  The  student  leads  the  interview  in  that  the 
interviewer  asks  questions  based  on  what  the  student  says  or  does  to  probe  into  or  clarify  the 
student’s  thinking.  The  interviewer  does  not  tell  the  student  what  he/she  should  or  should  not  be 
doing,  during  the  interview.  The  focus  should  be  on  discovering  unanticipated  thinking  processes  or 
mental  strategies  used  by  the  students. 

Detailed  flexible  interviews  can  be  time  consuming,  but  teachers  could  engage  in  a brief  sequence 
of  interviews  designed  to  clarify  the  students’  understanding  and  discovering  their  thinking 
processes.  However,  regardless  of  the  length  of  the  interview,  the  following  principles  should  be 
employed: 

i)  Use  open-ended  questions  [see  examples  below]. 

ii)  Ask  questions  that  follow  up  on  the  student’s  answers  to  reveal  interesting  aspects 
of  the  student’s  thinking. 

iii)  Elicit  some  reflection  from  the  student  to  obtain  further  evidence  concerning  the 
methods  of  thinking  he/she  is  using. 

iv)  Be  less  concerned  with  whether  the  student  gets  the  right  answer  and  more 
concerned  with  how  the  answer  was  obtained. 

The  following  is  a sample  of  questions  used  by  some  of  the  interviewers  in  the  EQI-Math  project 
that  resulted  in  meaningful  explanations/responses. 

1 . What  made  you  think  to  try  (or  do)  that? 

2.  What  made  you  think  of  that? 

3.  Can  you  explain  to  me  what  you’ve  just  done? 

4.  Can  you  explain  to  me  how  you  figured  that  out? 

5.  That’s  really  interesting  but  I don’t  think  I caught  what  you  were  saying,  can  you 
explain  it  again? 

6.  What  does  your  answer  mean? 

7.  What  are  you  thinking? 

8.  Can  you  describe  to  me  in  your  own  words  what  the  question  is  asking  you? 

9.  That’s  interesting,  how  did  you  know  to  try ? 

10.  Can  you  tell  me  what  it  is  that  you  are  going  to  have  to  do  for  this  problem? 

1 1 . How  do  you  know  that ? 

12.  Can  you  tell  me  what  you  mean  by ? 

13.  I’m  just  curious  to  know  how  you  thought  to  do  that? 

14.  How  could  you  check  that  that  answer  is  right? 
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NOTE:  Questions  that  had  “why’  in  them  did  not  get  useful  responses. 

For  example: 

Can  you  tell  me  why  you  said  three  or  more  ways? 

A.  1 don  t know. 

Why  did  you  do  that? 

A.  Probably  because  I am  only  good  at  counting  by  twos. 

In  general,  “why”  questions  and  questions  requiring  yes/no  answers 
(i.e.  closed  ended  questions)  should  be  avoided. 

The  interviews  conducted  by  the  EQI  project  provide  some  useful  situations  that  can  inform  us 
of  the  merits  of  interviewing  or  having  students  talk  about  their  thinking.  A sample  of  6 of  these 
situations  follows. 

CASE  1:  Interview  with  a grade  5 student 
Problem:  How  many  five-cent  and  eight-cent  stamps  can  you  buy  for  exactly  $2.43? 

This  interview  allows  us  to  see  the  unique  thought  process  of  this  grade  5 student  as  she  explains 
her  mental  computation  in  going  from  one  number  to  the  next  using  increments  of  8,  for  example, 

48  + 8 = 56. 

Student:  ....  / just  imagined  in  my  head,  um  like  'cause  um  because  in  the  classroom  we  have 

a big  board  and  it's  a number — and  um  I usually  look  at  it  and  I say  to  myself well, 
then  we  could  go  I know  from  48  more  is  48  and  then  if  I imagine  the  board  and 
I go  up  8 more  until  you  still  have  a 2 in  that  40,  andthenyougo  up  another  46  'cause 
2 plus  4 is  3.... 

Ok,  40  up  another  8 is  48  and  then  you  know  there's  still 2 in  the forties  left  and  then 
you  go  up  4 more  and  you  get  a 6 but  it's  in  the  ffties  now.... 

Just  keep  going  like  that.  ... 

On  the  surface,  this  student  may  be  perceived  to  not  be  making  any  sense  and  dismissed  by 
teachers  who  are  not  willing  to  listen  to  understand  the  student’s  way  of  thinking.  The  student  is 
actually  using  a mathematically  sophisticated  process  to  deal  with  simple  addition.  She  is  using  the 
associative  property  of  addition  to  work  in  “tens”.  So,  48  + 8 becomes  48  + (2  + 6)  = (48  +2)  + 6 = 50 
+ 6 = 56. 

In  her  head,  she  does  not  go  through  these  formal  steps,  but  simply  pictures  that  to  add  48  and  8, 
48  needs  2 more  to  complete  the  40’s  and  the  remaining  6 should  be  in  the  50’s  to  get  56. 

If  this  student  had  made  an  error  in  her  computation  on  her  worksheet,  correcting  her  in  terms  of 
a more  traditional  approach  may  only  confuse  her.  Thus  having  her  explain  her  mental  process 
provided  useful  information  to  help  her,  when  necessary,  in  a meaningful  way.  In  general,  this 
situation  suggests  that  we  cannot  always  assume  that  students’  thinking  are  simplistic  or  follow  a 
traditional  pattern. 
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CASK  2:  Interview  with  a grade  2 student 

Problem:  BUly  had  14  marbles.  He  gave  one-half  of  his  marbles  to  Tom.  How  many  marbles 

does  Billy  have  left? 

This  interview  with  this  grade  2 student  shows  the  importance  of  letting  the  students  read  the 
problem  aloud,  if  they  encounter  difficulties  in  starting  the  solution,  to  assess  the  situation. 

[In  the  following  S = student,  I = interviewer] 

S:  (reads)  Billy  had  14  marbles.  He  gave  one  himself  to  his  marble  to  Tom.  Howmany 

marbles  does  Billy  have  left^ 

I:  Let’s  look  back  at  the  middle  sentence  again.  Read  this  again. 

5;  He  gave  one  himself. 

I:  Now  let’s  look  at  that  word  again. 

5;  Help? 

I:  That’s  close,  that’s  half. 

5;  Half  he  gave  one-half  to  his,  he  gave  one-half  of  his  marbles  to  Tom. 

I:  ...  now  read  the  whole  thing  again. 

5;  Billy  had  14  marbles.  He  gave  one-half  to  of  his  marbles  to  Tom.  How  many 
marbles  does  Billy  have  left? 

The  student  was  initially  unable  to  solve  the  problem  correctly  not  because  of  a lack  of 
understanding  of  the  problem,  but  difficulty  in  recognizing  one  word.  She  demonstrated  this  by 
immediately  and  quickly  solving  the  problem  once  the  word  was  corrected. 

S:  Ids  um,  ids  asking  you,  like,  Billy  had  14  marbles.  Then  he  gave  one  of  his  halves 

to  Tom  so  he  is  asking  you  how  much  do  he  have,  does  he  have  left  of this  marbles  but 
not  counting  Tom's. . . 

7 ^7  is  14,  right? 

So  he  gives  one-half  to  Tom,  so  there  is  14  marbles ... 

So  he  gave  one-half,  so  he  gave  7 marbles  to,  he  cut  it  off  right  here,  he  gave  this  to 
his  friend  and  then  would  have  seven  marbles  left .... 

It  should  be  noted  that  the  meaning  of  the  word  “half’  was  not  explained  by  the  interviewer, 
neither  the  meaning  of  the  problem,  when  the  student  could  not  identify  the  word.  It  should  not  be 
assumed  that  if  a student  makes  a reading  mistake,  the  word  or  the  problem  should  be  explained. 
Instead  only  the  misread  word  should  be  corrected  and  the  student  allowed  to  interpret  the  problem 
on  his/her  own  before  further  intervention. 

In  this  case,  the  interview  allowed  us  to  separate  difficulty  with  language  from  difficulty  with  the 
problem  solving  process  to  better  assess  the  latter. 
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CASE  3:  Interview  with  a grade  2 student 

Problem:  Show  how  many  ways  you  can  put  7 cookies  in  2 cookie  jars. 

This  interview  with  this  grade  2 student  reveals  the  student’s  level  of  thinking. 

S:  ...  You  can  put  three  cookies  in  one  and four  cookies  in  the  other;  or  you  could  put  two 

in  one  and  two  in  the  other. . . 

(*)  Oh,  you  could  put  three  in  this  one,  three  in  this  one,  like  one  apart,  and  put  one 
piece  in  one  jar. 

And  you  can  take  two  cookies,  put  it  in  here,  and  take five  cookies  and  put  it  in  here. 

Take  six  cookies,  put  it  in  here,  put  one  cookie  in  there. 

Or  seven  in  this  one  and  none  in  that  one. 

The  student  recorded  all  of  these  possibilities  diagrammatically  and  numerically  except  (*).  The 
interviewer  asked  him  to  explain  this  possibility. 

S:  YoucouldputS  inhereandS  inthere,  thenbreaktheminhalf and  then  put  the  other 

2 pieces  in  there. 

I:  Could  you  put  that  one  down  too? 

S:  Three ...  whoops,  um  1 don't  know  how  lean  explain  this  one. 

I:  You  can  write  it  in  words  if  you  want  to. . . 

He  did  the  following: 


H^-ff  OInc;] 
Hc/ff 


This  interview  allowed  us  to  capture  processes  one  may  not  associate  with  this  student’s  grade 
level.  This  student  was  able  to  conceptualize  the  problem  beyond  whole  numbers  (i.e.  3 1/2),  but 
lacked  the  numerical  symbolic  knowledge  to  record  it.  Without  the  interview,  this  might  not  have 
surfaced  and  both  the  student  and  teacher  would  have  failed  to  validate  this  creative  thinking. 
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CASK  4:  Interview  with  a grade  2 student 

Problem:  Sally,  Tina  and  Mary  were  trying  to  line  up  at  the  water  fountain.  Show  how  many 

ways  the  girls  could  line  up  if  Mary  always  had  to  be  first? 

This  interview  shows  how  this  grade  2 student  uses  his  own  experience  and  vocabulary  to 
understand  the  problem. 

S:  ...  urn,  let's  see  here. . .Am  I asking  to  budge  somebody^ 

I:  I don’t  understand  what  you  said. 

5.-  By  asking  to  budge  somebody,  they  could  be  first. 

I:  Oh,  you  think  that  they’re  butting  in  you  mean. 

S:  Yuh. 

The  student  experienced  difficulty  because  he  did  not  know  how  to  show  the  girls  “budging”. 
After  further  discussion  and  some  guidance  from  the  interviewer,  he  finally  was  able  to  represent  the 
“budging”  as  follows: 


He  was  then  able  to  solve  the  problem  using  the  diagram. 

S:  ...  She  could  go from  back  here  and  budge,  and  then  go  to  there.  A nd  there 's  another 

way ...  and  then  just  budge  that  person.  There's  two  ways. . . 

In  this  case,  the  interview  informed  us  of  the  language  that  was  meaningful  to  the  student  to 
help  him  solve  the  problem. 
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CASK  5:  Interview  with  a grade  8 student 

Problem:  Jennifer  and  Mandy  like  to  ride  bicycles.  Jennifer  can  ride  6 km  in  the  same  time 

Mandy  can  ride  4 km.  The  girls  want  to  ride  9 km  to  Fish  Creek  Park  and  arrive  at 
the  same  time.  How  much  of  a head  start  should  Mandy  have? 


B. 


In  this  interview  the  student  read  the  problem,  took  a few  seconds,  then  said:  I think  it’s  1.5. 

I:  How’d  you  get  that? 

S:  Ok,  well,  1 multiplied  1.5  x 4,  so  that's  that.  Ok.  And  I got  6,  which  is  that.  And 

then  I timesed  that  and  1 got  9.  Just  a sec. 

This  response  is  part  A of  her  written  work — a “proof’  of  1.5,  which  doesn’t  work.  The 
interviewer  asked  if  she  could  illustrate  her  answer  by  drawing  a picture.  She  did  this  in  part  B of  her 
written  work  with  the  following  explanation. 
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S:  They  re  both  here,  hey,  this  is  Mandy  and  this  is  the  other  one.  And  say  she's  going 

4 km  and  she's  going  6,  like  that,  eh?  She's  slowly  gettin  away farther  and farther, 
so  like  if she  went  like,  if she  went  4,  she  would  get  this,  then  she  would  get  that,  but 
she  would  be  here  when  she  starts,  so  she  would  like  be  ahead.  She'd  get  to  there.  She 
would  go  4,  she  would  go  here,  and  this  one  goes  to  there,  she'd  have,  Mandy  d have 
a head  start  all  the  time. 

(...) 

I:  You  got  1.5  easy.  How’d  you  get  that? 

S:  Well,  I just  kind  of  looked  at  it  and  I said,  '"that's  gonna  be  2 ahead  of  this — they're 

both  even  numbers . . . and  to  get  that  you.  ..sol  was just  thinking,  these  are  both  even 
numbers  and  this  is  an  odd  number  and  the  difference  between  these  is  2 and 
maybe. . . to  get  it  there. " 

u 

S:  The  answer,  I think,  is  1.5. 1 got  this  by  seeing  the  differences  in  the  numbers  and 

multiplying  to  check. 

The  interview  shows  that  the  student  understood  the  context  of  the  problem  but  not  how  to 
translate  it  mathematically.  So  she  ignored  the  context  of  the  problem  and  simply  worked  with  the 
numbers,  seemingly  convinced  that  this  was  logical  even  though  it  did  not  check  out.  Even  with 
coaching  from  the  interviewer,  she  wasn’t  able  to  make  the  necessary  connection  between  the 
problem  situation  and  the  maths.  But  she  was  “happy”  with  her  solution. 

Without  the  interview,  this  difficulty  may  not  have  been  uncovered  since  written  solutions  cannot 
provide  what  the  student  is  not  aware  of.  Talking  with  the  student  will  help  the  teacher  to  see  such 
inconsistencies  or  conflicts  in  her  problem  solving  approach  and  be  in  a better  position  to  provide 
more  meaningful  help. 
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CASK  6:  Interview  with  a grade  10  student 

Problem:  525  can  be  written  as  the  sum  of  consecutive  numbers. 

A.  Find  a set  of  consecutive  numbers  that  will  work. 


Student’s  work: 


TS  — f" 

- *^jr4(D 

a-,  ^40 

* riSO 

3-v  - 


C: 


^-4.  ' 


This  student  describes  the  problem  as  “confusing”  and  the  way  she  felt  after  trying  to  solve  it  as 
“frustrated”.  The  interview  allows  us  to  see  why  the  student  made  these  assessments. 

The  student’s  written  work  would  seem  to  contradict  her  assessment  given  the  brevity,  neatness 
and  well  structured  lay  out  of  it,  including  a correct  answer.  But  what  is  lost  on  the  page  are  the 
human  factors  of  the  problem  solving  process,  the  struggle  and  effort  the  student  went  through  or 
exerted  to  arrive  at  a solution.  This  is  similar  to  the  way  students  do  not  see  the  struggle  of  others, 
particularly  the  teacher,  when  thought  processes  are  not  shared,  but  a tidy  solution  is  presented  on 
the  blackboard  and  the  student  is  led  to  believe  that  problem  solving  is  effortless  and  magical. 

This  interview  also  shows  that  the  linear  flow  of  the  solution  does  not  reflect  the  actual  flow  of 
the  student’s  thinking,  i.e.  one  does  not  necessarily  get  to  a solution  in  a direct,  linear  manner. 
Finally,  this  interview  provides  the  student’s  rationale  from  the  student’s  perspective  for  her  process. 
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The  following  are  excerpts  from  the  interview. 

S:  (oft^  readingproblem)  r m just  wondering  how  many  numbers  this  is  going  to  take 

and  where  to  start. 

Well,  since  ids  askingfor  consecutive  numbers,  you just  try.  I think  I will  start  with 
the  one  plus  two  plus  three  and  see  where  that  takes  me. 

Well,  since  it  asks  for  the  sum  of  the  consecutive  numbers,  I wouldn't  really  know 
where  to  start,  because  you  don't,  I guess  starting  with  one  would  be  too  small, 
because  it  would  take forever,  but  another  point,  you  don't  want  to  start  too  high 
either. 

Ok,  Fm  just  wondering  where  to  start.  I could just  start  with  75,  because  it  doesn't 
have  a certain  number  of  numbers  that  you  can  use.  Like  saying  that  you  can  only 
use  five  numbers.  You  can  use  as  many  as  you  want  and  I think  that  it  makes  it 
harder  and  a lot  longer. 

( Starts  part  A of  written  work.)  Ok,  Fm  going  to  start  with  7 5,  just  add  76,  that 
givesmelSl,  add77,  it  gives  me 228,  add78,  79, 385,  add 80, 465,  and  81. 1 don't 
think  will  work.  Too  large. 

(Why  start  with  75?)  Weill  don'twant  to  start  too  low  because  I thought  it  would 
take  too  long,  like  starting  with  one  plus  two  plus  three  and  so  on. ...  It's  not  exactly 
half or  anything  along  the  lines  of half  of 525. 1 just  started  because  I didn't  want 
it  too  large  or  too  small. 

Okay,  well  Fll just  write  down  what  I have,  starting  with  75  and  going  to  81. 1 
think  it  gave  me 546,  so from  here  there  are  so  many  different  numbers  that  you  could 
use. 

(Switches  approach.)  Ok,  well  Fll  just  see  approximately  what  half  of 525  would 
be.  It  would  be  about 260. 1 could  start  with  that  and  see  what  happens.  It  would 
be  too  large  though,  because 260 plus  261  would  equal  521  andthat  wouldn't  work 
because  we  are  using  the  two  largest  numbers  and  in  a question  like  this,  it  looks  so 
simple  when  I first  look  at  it,  but  the  longer  you  work  on  it  the  longer  it  takes. 

(Switches  back  to  initial  approach.)  Well,  Fll  try  it  with  70,  because  546  was 
closer  to  525  than  what  I just  got.  (...)  gives  me  a larger  number. 

(...)  so  maybe  I will  start  with  something  even  smaller.  F ll  start  with  50 just  to  see 
what  I come  up  with.  (...)  That's  still  too  high  but  it's  lower  than  I got  with  75 
through  81. 

(...)  So  I guess  if  I start  with  something  a little  lower,  maybe  if  I start  with  25. 

[After  computing  the  outcome  starting  with  25,  she  next  tried  starting  with 
26  then  24.] 

I still  know  there  is  something  I can  do  that  is  a lot  easier,  but  I can 't figure  out  what 
it  is. ... 
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Ok,  we  did  something  kind  of  like  this  before  in  math.  (Switches  to  part  B of 
written  work.)  We  were  trying  to find,  I think,  even  numbers  added  together  that 
were,  that  gave  the  sum  of,  I think,  101.  Because,  if  you  add  one  and  then  you  add 
525,  that  would  give  you  526.  Then  when  you  go  on  it's  two  plus  524  and  that 
would  equal 526,  and just  one  more,  three  plus  523  equals  526.  Now  where  to  go 
from  there  I don't  know,  because  this  isn't  exactly  the  same  question. 

(Switches  to  part  C of  written  work.)  ...If I started  with  half  of 525  again,  or 
approximately  half , so  half  of 525  equals 262.5.  Now  ifyouhad262  and263,  that 
would  give  you  525.  So  that  would  be  one  set. 

In  general,  this  interview  informs  us  that  we  need  to  be  aware  of  what  students’  thought  processes 
actually  look  like  to  be  sensitive  to  when  and  how  to  intervene  in  their  thinking  to  provide  help. 
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SECTION  3 HOLISTIC  ANALYSIS 
A FOCUS  ON  WRITTEN  WORK  ▼ 

HOLISTIC  RESPONSE  CRITERIA 

EQI-Math 
Pilot  1991-2 

PfeErmnary  Response 

No  attempt 

Words  do  not  reflect  the  problem: 

• diagrams  and  drawings  unclear  or  misrepresent  the  problem;  and/or 

• does  not  indicate  which  information  is  appropriate  to  flnding  a solution. 

Begins,  but  fails  to  move  toward  a solution. 

Partial  Reaponae 

Begins  the  problem  in  a manner  that  could  lead  to  a solution  but  fails  to  complete  ir, 

• omits  a significant  part  of  the  problem; 

• makes  a major  computational  error 

• uses  an  inappropriate  strategy  for  solving  the  problem. 

Provides  a solution,  but  explanation  unclear; 

• argument  or  explanation  incomplete; 

• diagram  is  inappropriate  or  unclear. 

(A  correct  answer  with  no  evidence  to  support  the  solution  must  be  further 
supported  by  an  interview  or  else  there  is  no  basis  on  which  to  judge  the  process.) 

Complet<5  Response 

Gives  a complete  response  that  includes  a full  solution  with  reasonably  clear  explanations; 

• communicates  sound  supporting  arguments; 

• shows  understanding  of  the  mathematical  ideas  and  processes. 

Elegant  Response^ 

Gives  a complete  response  with  an  “elegant”  explanation; 

• unusual  insight  displayed  in  solution; 

• communicates  strong  supporting  arguments. 
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The  EQI-Math  project  identified  these  Holistic  Response  Criteria  as  a basis  of  interpreting  and 
assessing  written  solutions. 

To  provide  some  guidance  to  encourage  teachers  to  use  these  criteria,  an  extensive  sample  of 
students’  solutions  (grades  2,  5,  8 and  10)  with  sample  assessments  prepared  by  experienced 
mathematics  teachers  are  included  in  this  section. 

Given  that  the  teaching  of  problem  solving,  particularly  through  the  use  of  non-routine 
problems,  is  a new  focus  in  the  mathematics  curriculum,  it  will  require  more  experience  with  the 
teaching  of  it  before  more  reflective  assessments  of  students’  work  will  surface.  Consequently,  the 
sample  assessments  presented  here  are  not  intended  to  be  a prescription.  They  illustrate  how  a 
sample  of  experienced  teachers,  beginning  to  use  the  holistic  response  criteria,  viewed  the  students’ 
solutions.  Thus  these  samples  provide  a point  of  entry  for  teachers  into  the  assessment  process  and 
are  not  intended  to  be  a point  of  exit  in  terms  of  what  an  ideal  assessment  would  look  like.  The 
eventual  goal  is  for  teachers  to  see  beyond  the  traditional  structure  (for  example  focus  on  mechanical 
and  cognitive  steps)  of  solutions  to  identifying,  appreciating  and  validating  the  creative,  intuitive  and 
experiential  thinking  that  are  integral  features  of  real  world  problem  solving. 

Teachers  are  encouraged  to  use  the  samples  as  benchmarks  to  help  them  to  evaluate  or  reflect  on 
what  they  have  been  doing,  should  be  doing  or  will  like  to  do.  In  general,  teachers  should  use  the 
samples  to  make  more  sense  of  their  own  situations,  to  question  themselves  about  how  they  would 
react  to  the  same  or  a similar  situation,  thereby  becoming  more  aware  of  what  they  do  or  not  do 
when  assessing  students’  written  work. 

The  sample  assessments  reflect  significant  variations  in  the  perspectives  used  by  the  teachers.  For 
example,  the  grade  2 samples  reflect  a personal  reflective  style  of  assessment,  that  is,  a description  of 
how  the  teachers  viewed  the  students’  processes.  The  teachers  focused  more  on  understanding  what 
the  students  did  as  opposed  to  making  judgements  with  respect  to  what  they  should  have  done.  In 
contrast,  the  grade  8 samples  reflect  an  impersonal  style  of  assessment.  Some  of  the  teachers  focused 
on  making  judgements  of  what  the  students  should  have  done,  with  little  or  no  attention  to 
describing  how  they  (the  teachers)  understood  or  viewed  what  the  students  had  done.  It  is  not  being 
recommended  that  one  perspective  should  be  used  over  the  other.  Instead,  teachers  should  try  to 
consider  and  incorporate  all  meaningful  aspects  of  these  perspectives  to  effectively  assess  their 
students. 
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The  words  eight  and  eight  above  the  picture  indicate 
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solve  this  problem: 


Mary  Jane  saw  8 rabbits. 

How  many  ears  did  those  rabbits  have  in  all? 
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I am  a number  less  than  10. 

I am  also  greater  than  6. 

You  say  me  when  you  coimt  by  2's. 
Who  am  I? 
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The  way  this  is  written  out  is  curious.  The  student  has 
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solve  this  problem: 


I am  a number  less  than  10. 

I am  also  greater  than  6. 

You  say  me  when  you  count  by  2's. 
Who  am  I? 
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I feel  the  child  was  able  to  answer  this  problem  easily. 
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solve  this  problem: 


The  circles,  erase  mark  and  the  three  dijferent  sets  of 
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1 am  a number  less  than  10. 

I am  also  greater  than  6. 

You  say  me  when  you  count  by  2's. 
Who  am  I? 


The  number  sequence  written  down  makes  me feel  this 
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The  way  this  child  worked  out  this  problem  on  the 
paper  nves  us  an  interesting  look  into  how  they,  at  this 
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Show  how  many  ways  you  can  put  7 cookies  in  2 cookie  jars? 


This  chili j solution  is  complete  even  though  all possible 
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solve  this  problem: 


Show  how  many  ways  you  can  put  7 cookies  in  2 cookie  jars? 
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This  child  approached  the  problem  differently  than 
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Billy  had  14  marbles. 

He  gave  one-half  of  his  marbles  to  Tom. 
How  many  marbles  does  Billy  have  left? 
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The  child  has  personalized  this  problem.  The  two 
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Discouraged  Satined  Frustrated  [Happy 
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The  explanation  tells  us  the  student  worked  with 
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solve  this  problem: 


Billy  had  14  marbles. 

He  gave  one-half  of  his  marbles  to  Tom. 
How  many  marbles  does  Billy  have  left? 
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solve  this  problem: 
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Discouraged  Satisfied  Frustrated  f Happy 


Show  how  many  different  ways  you  could  walk  from 
Billy's  house  to  Mary's  house  . 
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This  delightful  response  needed  comment.  The  child 
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Show  how  many  different  ways  you  could  walk  from 
Billy's  house  to  Mary’s  house  . 
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This  student  did  not  complete  the  problem  to  four 
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Show  how  many  different  ways  you  could  walk  from 
Billy's  house  to  Mary's  house  . 


n X 


V 


o 


This  complete  response  demonstrates  organized^ 


I I 
. 

*5?  ^ 

'a  o 

5^  > 


I ^ 

Si 

S I 


<3 


VO 


<N 


u 

n3 


a 


solve  this  problem: 


2 « 
•a  "S 

2 C/5 


& ^ 
CO  CO 


ftS 

o 


>*J 


o 

tl3 

Co 


4-- 


Ok-  \oer) 


I had  to  include  this  response  to  comment  on.  This 
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This  response  looks  dijferently  at  the  interpretation  of 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem: 

Discouraged  ( Sad^^  Frustrated  Happy 
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This  child  has  systematically  completed  all  three 


5 s 

• S 

vi  >«* 

.c  .2 

>*«* 

^ .§ 

c> 

-S  I 


t>o  "is 

S 


S4 

ja 


■55 


^ 1:5 


:i  ^ 


Si 

^ 2 


§ -t: 

t^'l 

S5  H 


5) 


<3 

1 

I 


r 

s 

I 


g 


i I g 


r 

5 


I 


•I 


t' 

c> 


C 

<5 


•S) 


^c~. 

i| 

^ S 

K e 

ly 

S § 

s t 

aiJti 


5 


■io 


- ^ ^ W 
3 ^ J 

-u  o-'i" 


u 

•s 

*s  ^ 

I - 

O Cjq 

t> 

B 

U 


CO 

VO 


V 

n3 

rt 


o 


Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem: 

Discouraged  Frustrated  Happy 
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Discouraged  Satisfied  Frustrated  Happy 


Here  is  the  elegant  response  to  the  problem!  Perhaps 
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solve  this  problem: 
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The  student  thought  of  two  mystery  numbers  but 
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solve  this  problem: 


Judith  is  thinking  of  2 mystery  numbers. 

One  number  is  18  less  than  the  other. 

Both  are  two-digit  numbers  that  are  divisible  by  3 but  not  by  6. 
Show  how  you  found  these  mystery  numbers. 


The  student  wrote  multiples  of  3 and  6 and  eliminated 
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solve  this  problem: 


Judith  is  thinking  of  2 mystery  numbers. 

One  number  is  18  less  than  the  other. 

Both  are  two-digit  numbers  that  are  divisible  by  3 but  not  by  6. 
Show  how  you  found  these  mystery  numbers. 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem: 

Discouraged  ^ti^ei  Frustrated  Happy 
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The  student  began  with  the  number  4 and  counted  by 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem: 

(PikdW^g^  Satined  Frustrated  Happy 


Dale  was  using  a stencil  to  make  numerals 
for  the  art  work  display  at  school. 

There  were  100  pieces  of  art  to  be  numbered  in  order 
from  1 to  100. 

How  many  4’s  will  Dale  have  to  make? 
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solve  this  problem: 


Dale  was  using  a stencil  to  make  numerals 
for  the  art  work  display  at  school. 

There  were  100  pieces  of  art  to  be  numbered  in  order 
from  1 to  100. 

How  many  4’s  will  Dale  have  to  make? 
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The  student  began  the  problem  correctly  but  got 
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Dale  was  using  a stencil  to  make  numerals 
for  the  art  work  display  at  school. 

There  were  100  pieces  of  art  to  be  numbered  in  order 
from  1 to  100. 

How  many  4's  will  Dale  have  to  make? 
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The  student  began  sequentially  by  selecting  possible 
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The  student  tried  possible  solutions  of  multiples  of  5 
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solve  this  problem: 
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The  student  began  by  illustrating  multiples  of  3,  4, 


1 


1,  c" 


I 


15 


"5^ 


•S 

<a 


k. 

t 

f 

c 


.§ 

5S 


J 


1 


CP 

R 

• S 
c 

t- 

o 

5C 


tso 


1 

is 

s; 

« 

cs 


R 

CS 


t 


• S RJ 

§ 

!-> 

■s 

I 

^ cs 


k: 

>S 


s; 

a 


•& 

J 


k. 

*:S 


« t 

J I 
s 


a 


a 


How  many  five-cent  and  eight-cent  stamps 
can  you  buy  for  exactly  $2.43? 
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This  student  used  an  interesting  approach  that  begi 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem: 

Discouraged  Frustrated  Happy 


How  many  five-cent  and  eight-cent  stamps 
can  you  buy  for  exactly  $2.43? 


ON 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem; 

Discouraged  Satined  Frustrated 


How  many  five-cent  and  eight-cent  stamps 
can  you  buy  for  exactly  $2.43? 
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The  student  began  by  finding  values  of  5 cent  stamps 
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solve  this  problem: 
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This  is  a complete  response.  Before  beginning  the 
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solve  this  problem: 
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The  student  could  demonstrate  understanding  better 
by  usin?  new  words  rather  than  just  rewriting. 


) 


3 


I 


.2 

-i 

I 

E? 


k. 

a 

c 

I "2 

^ .S 
^ .§ 

15  5 

VO 

55 
<5S 


I 


§ 


I 

I 


O 


I 

1 


VO 


5J 


k. 


<a 


I 


• S 


I 5 

: ■§ 

^ 2 

I i 

<1 

’g 


5=^  C 

-I 


^ 'o  5 

0 QV  ^ 

i ^ 

1 

Jii  a 


.=  -§ 


VO 


1 


^ t 

*-  .1 
.1  ^ 


.I’  -S 

^ "2 

2 

S 

C5 


Va 

I I 


VO 


• S 5=^ 

C> 


s; 

» 


o 

euQ 

.S 

o 


® I 

C .2 

® -S 


00 

u 

'tS 

2 

o 


( 


The  student  displays  a clear  understanding  of  the 
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This  student  has  demonstrated  a complete  and  unique 
response  to  the  problem.  The  student  has  related  some 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem: 

Discouraged  ( Satined  ) Frustrated  Happy 
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The  student  has  read  and  clearly  understood  the  clues, 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem:  

Discouraged  Satisfied  Frustrated  /^Happy^ 
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fully  understands  the  clues  and  is  able  to  think  and  having  to  write  it  all  down, 

reason  well  logically.  It  appears  that  this  student,  after 
some  valid  observations  and  finding  an  answer,  forgot 
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This  is  an  example  of  a student's  response  in  the 
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Grade  8 


This  is  an  example  of  a preliminary  response  written 
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Eleven  people  are  introduced  to  each  other.  Explain  how  you  would  solve  the  problem 

and  each  person  shakes  hands  with  each  other  exactly  once.  if  49  people  were  to  shake  hands  once  with  each  other. 

How  many  handshakes  arc  exchanged  altogether? 
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The  student  developed  a strategic  approach  by  using  a 
diagram,  listing  totals  and  finally  writing  these  in 
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The  student  has  approached  the  problem  initially 
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This  response  would  be  rated  partial.  It  would  be 
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solve  this  problem:  The  Student  appears  sati^edwiththeresponse  although 

Discouraged  Satisfied  Frustrated  > no  reflection  is  completed. 

The  attitudinal  response  is  “boring.  ” 
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In  the  extensiony  the  student's  creativity**  is  Now  look  at  the  completion  of  your  new  pattern. 

demonstrated  in  the  development  of a pattern  adding  What  numbers  did  you  addf 

the  40sy  the  30s,  etc.  Hint:  The  49th  person  would  shake  hands  with 

how  many  people? 

How  can  you  change  this  pattern  ? 


1 


§ 


^ -s 


«3 

■§ 

i 

c» 


S 


:§ 

5* 

.o 


"5? 


R 

<Xj 

cS  ^ 

% ^ 5 

^ 'f. 

?S  » 

•g  5 
S 

S «->  § 

- -s  ^ 

« i 5 

^ %•  t5 


^ ■<? 

'Kk 

|o  S 

g "*r 
« ^ 


<N 


■v* 

<N 


§ 

, v> 

? 

-Si 

•S 

5C 

<3 


55?  cvj. 
^ !^! 
b ^ 
S ^ 

-I 

■c- 

-Si 
^ -5 

9 


Q e^.  ^ 


O r; 

!>:: 


§ 


-Cj 
~«i 


,1, 


•I 

'C 

'O 
VO 

I 

®v>. 

^ 'bi  ^ 


i « 


I 


-o 

R 


J 1^ 

"S- 

<N  5 


to  x!^ 

=1  S 
1 - 
^ 1 
2:1 
I ^ 

^ b 
« 

•go-S 

fl 

§ *b 

I I 


-:S  s-j 
s? 

I § 
ef 

Nd  ^ 

• S b 

5 V 


i ^ 


a 


•1^ 


I .r 


s -j 


r^ 

(N 


t- 

CJ 

◄ 


r 

o 


I’ 


Si 

s; 

o 


c 

So 

>3 

§ 


1. 


o 


-I 

-*«* 

c 

a 


e 


00 

1> 

no 


O 


response  by  writing  three  approaches  to  solving  the 
initial probleniy  the  long  way,  the  short  way  and  by 
pattern.  Note  the  simpler  diagram  above  (4 people) 
and  the  establishing  of  a pattern. 
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A Complete  ▼ 

The  student  displays  a strategic  approach  and  process 
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A Partial  t 

This  student  displays  a clear  understanding  of  the 
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solve  this  problem: 
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Jennifer  and  Mandy  like  to  ride  bicycles.  ^ 

Jennifer  can  ride  6 kto  in  the  same  time  Mandy  can  ride  4 km.  . 
The  girls  want  to  ride  9 km  to  Fish  Creek  Park  and  arrive 
at  the  same  time.  How  much  of  a head  start  should  Mandy  have? 
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A.  Partial  t 

The  student  has  shown  some  creativity  in  his  listing  of 
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solve  this  problem: 


A Partial/Complete  ▼ 
This  student's  response  is  rated  as  partial  to  complete. 
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The  student  has  appropriately  restated  the  problem. 
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The  student  has  restated  the  problem  and  has  suggested 
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The  student  has  restated  the  question  and  has  listed 
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Explain  how  you  would  determine  the  different  routes 

Ron  visits  his  friend  Nassar  so  often  that  he  likes  to  vary  his  route.  could  take  to  go  to  Mario's  house. 

If  Ron  never  moves  diagonally  and  never  walks  back  toward  his  own  [Remember  Ron  never  moves  diagonaUy  and 

house,  how  many  different  routes  can  he  take  to  go  to  Nassar  s house  house.l 
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It  appears  this  student  has  developed  a strategic 
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solve  this  problem: 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem: 
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solve  this  problem: 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem: 
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• Adopts  the  strategy  of  working  backwards. 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem: 
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Paving  stones  that  measure  1 x 1 are  used  to  make  a border  around  a 
rectangular  pond. 

In  the  example  below  the  pond  is  3 x 9 and  28  stones  are  used. 
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solve  this  problem: 


Take  any  four  consecutive  numbers;  multiply  them  together  and  add  1. 
Take  the  square  root  of  the  number. 

Is  your  fin^  answer  a whole  number? 
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• Student  tried  four  examples  in  parts  A andB  then 
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• Student  uses  a table  to  organize  the  trials. 
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• It  seems  that  the  student  enjoyed  sorting  out  the 
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• Use  of  prime  factors  to  find  the  LCM. 
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• Trying  different  strategies^  creative. 
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• Student  appears  to  understand  the  problem. 
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Discouraged  Satisfied  Frustrated  ,y  Happy 


Show  how  many  different  paths  there  are  from  the  Point  A to 
the  Point  B on  a 5 x 5 square  if  only  moves  to  the  right  or 
downward  along  sides  of  squares  are  permitted? 
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• Student  sets  up  a system for  finding  the  routes  to  any 
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Circle  one  of  the  following  words  that  describes  how  you  feel  after  trying  to 
solve  this  problem; 
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PROBLEM  SOLVING  DISPOSITIONS 

Motivated 

• shows  interest,  curiosity,  enthusiasm  and  inventiveness  in  doing  mathematics* 

• goes  beyond  the  assignment 

• reluctant  to  stop* 

• works  to  a goal 

• works  until  satisfied  with  solution 

• works  for  a lengthy  period  using  one  strategy 
Creative 

• flexible  in  exploring  mathematical  ideas* 

• tries  alternative  methods* 

• invents  own  problems,  formulates  problems 

• able  to  improvise  in  selecting  materials  to  represent  the  problem 
Confident 

• belief  in  ability  to  use  mathematics  to  solve  problems* 

• belief  in  ability  to  reason* 

• not  afraid  to  make  mistakes 

• belief  that  problems  can  be  solved 

• ability  to  identify  and  use  necessary  resources 

• prepared  to  demonstrate  for  other  students 

• belief  in  ability  to  communicate  ideas 
Strategic  Approach 

• can  state  the  problem  in  own  words 

• understands  the  meaning  of  words  in  the  problem 

• is  able  to  draw  a diagram  that  reflects  the  problem 

• knows  what  information  is  needed  to  solve  the  problem  and  what  information 
is  extraneous** 

Strategic  Process 

• uses  organized  and  logical  approaches 

• takes  time  to  stop  and  think 

• notices  and  corrects  one’s  mistakes** 

• monitors  ones  thinking*  - is  reflective 

* Terminology  used  in  NCTM,  Curriculum  and  Evaluation  Standards for  School  Mathematics^  1989.  p.  228 
**  Terminology  used  in  Alberta  Education,  Diagnostic  Mathematics  Program,  1991,  “Cognitive  Processes.” 

These  mathematical  dispositions,  identified  by  the  EQI-Math  project,  should  be  used  to: 

i)  frame  the  observations,  i.e.,  to  determine  what  aspect(s)  of  students’  behaviour 
to  focus  on; 

ii)  interpret  the  students’  actions. 

The  dispositions  describe  the  type  of  behaviours  that  are  associated  with  successful  problem 
solving.  Thus  they  should  be  used  as  a basis  of  determining  whether  a student  possesses  or  does  not 
possess  these  qualities.  It  is  more  useful  to  wait  after  a few  observations  before  making 
interpretations.  Interpretation  after  each  observation  could  be  misleading  since  a trend  cannot  be 
established  with  one  or  two  observations.  Only  a few  students  (1  to  4)  should  be  observed  in  a given 
problem  solving  situation. 
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HOLISTIC  RESPONSE  CRITERIA 


EQI-Math 
Pilot  1991-2 

Preliminaiy  Response 
No  attempt 

Words  do  not  reflect  the  problem: 

• diagrams  and  drawings  unclear  or  misrepresent  the  problem;  and/ or 

• does  not  indicate  which  information  is  appropriate  to  finding  a solution. 

Begins,  but  fails  to  move  toward  a solution. 

Partial  Response 

Begins  the  problem  in  a manner  that  could  lead  to  a solution  but  fails  to  complete  ir, 

• omits  a significant  part  of  the  problem; 

• makes  a major  computational  error 

• uses  an  inappropriate  strategy  for  solving  the  problem. 

Provides  a solution,  but  explanation  unclear; 

• argument  or  explanation  incomplete; 

• diagram  is  inappropriate  or  unclear. 

(A  correct  answer  with  no  evidence  to  support  the  solution  must  be  further 
supported  by  an  interview  or  else  there  is  no  basis  on  which  to  judge  the  process.) 

Complete  Response 

Gives  a complete  response  that  includes  a full  solution  with  reasonably  clear  explanations; 

• communicates  sound  supporting  arguments; 

• shows  understanding  of  the  mathematical  ideas  and  processes. 

Elegant  Response 

Gives  a complete  response  with  an  “elegant”  explanation; 

• unusual  insight  displayed  in  solution; 

• communicates  strong  supporting  arguments. 


The  EQI-Math  project  identified  these  Holistic  Response  Criteria  as  a basis  of  interpreting  and 
assessing  written  solutions. 
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